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TITIjE 

METHOD AND APPARATUS FOR CONTOUR TRACKING OF AN IMAGE 
THROUGH A CLASS OF NON LINEAR FILTERS 

DESCRIPTION 
5 Field of the invention 

The present invention relates to a method for 
detecting and tracking the contour of structures present 
in an image . 

Furthermore, the invention relates to an electronic 
10 arrangement where non linear filters are resident which 
can be applied inside contour detecting and tracking 
procedures . 

The images to treat can be of various type and 
coming from many fields, among which robotics, control of 

15 industrial processes, medicine, multimedia applications, 
safety systems, and can be color or grey levels images. 

In case of applications in medicine, i.e. in 
biomedical imaging, they refer normally to an organ and 
are obtained with various techniques such as ultrasonic 

20 pulses, PET, SPECT, CAT, MR, etc., which can be anatomical 
images, or images of function, obtained by means of time 
sequences of anatomical views of a particular zone of the 
organ, or images of perfusion, obtained on the same organ 
after treatment of the patient with substances that 

25 highlight the perfusion in the organ. Or, the images can 
be graphs (es. ECG) acquired by a scanner, thus allowing 
to a paper graph to be converted into a digital signal. 

Moreover, bidimensional images may turn into 
volumetric images or panoramic images if acquired as 

30 slices of spatial sequences. 

Contour tracking is a relevant aspect of image 
control procedures, since it is frequently used in the 
above fields. A contour, defined as a quick variation of 
intensity and/or color between two adjacent regions, can 
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be tracked following different approaches among which the 
most frequently used are based on first and second order 
derivative filters . 

First order derivative filters 

5 First order derivative filters measure the variation 

of the light intensity in a predetermined area of interest. 
Any discontinuities in this case are detected searching for 
local maxima of the output of a derivative filter. 

One of the most used filter is the gradient of 

10 Gaussian (GoG) , whose output is satisfactory on straight 
contours without crossings with other contours, but tends to 
loose efficiency in the presence of contours with high 
aperture (i.e. at bends), at the end of lines or on bars, as 
well at crossings with other discontinuities and in isolated 

15 points (spots) . In the presence of noise the use of a 
predetermined threshold allows to discriminate any spurious 
local maxima from local maxima due to discontinuity. Many 
procedures use a single and predetermined threshold value on 
all the image. This type of approach is however not much 

20 effective since the features of the image (brightness, 
contrast, noise etc.) are not, normally, constant on the 
whole area. For example, the darkest parts of an image are 
often derived from variation of intensity less than from 
brighter areas. Then, a threshold value suitable for bright 

25 zones cannot be suitable for darker zones and vice versa. 
These problems have brought to the development of prior art 
procedures capable of tracking locally the threshold values 
that better fit to a specific area of the image, associating 
to each pixel of the image a threshold owing to the 

30 brightness variation. In particular: 

- US6094508 uses a determined threshold through a model 
that approximates and measures the output of the human sight 
to the variation of local intensity; 

- EP0414505 uses a dynamic threshold determined by an error 
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estimation of the diffusion in a neighborhood about each 
point of the image. 

- US6061476 uses an approach in which, through a 
subtraction technique, a threshold is sought that is 

5 proportional to the contrast between the background and the 
feature to track. 

- US4220972 solves the problem of tracking contours from 
images with low contrast, using a threshold proportional to 
the local brightness of the image. 

10 Derivative filters of the second order. 

Derivative filters of the second order output a zero- 
crossing at the contour of structures present in the images. 
This zero-crossing is due to the fact that the contours are 
defined as discontinuities, at which the intensity of the 

15 output meets the value zero. 

The most common derivative filter than the second 
order is the Laplacian of Gaussian (LoG) , widely used in 
computer vision applications. It is often approximated by a 
Difference of two Gaussian curves (DoG) having different 

20 aperture. In this case the detection of the contours is 
based on searching zero-crossing points of the output of the 
derivative filter. This operation is not easy, especially in 
the presence of noise, because the second order derivation 
enhances the noise. 

25 Also in this case, the noise is approached using a 

step of thresholding, for example as in US5086219, adopting 
a threshold according to the strenght of the zero crossing, 
i.e. to the slope of the curved point at the zero crossing; 
the reason is that, normally, to the discontinuity 

30 correspond more intense zero-crossings (i.e. zero crossings 
with much higher slopes) than those elsewhere typical of the 
noise, which in this way can be filtered. 

Alternatively, US5142592 describes a procedure based 
on the LoG filter for detection of close contours and 
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parallel to each other; in this case, parallelism is a 
condition exploited for reducing the problems deriving from 
the presence of noise. 

Normally, the derivative filters of first and second 
5 order give a poor output at angles, edges, vertices, 
intersections, variation of aperture, etc., and this causes, 
in addition to a not completely satisfactory result, also an 
heavier computational load. 

Summary of the invention 

10 It is a feature of the present invention to provide a 

method for detecting and tracking contours of an image that 
allows to obtain an image with detail normally higher than 
that obtained with the methods of prior art. 

It is another a feature of the present invention to 

15 provide a method for detecting and tracking contours of an 
image for a highlighting with very good resolution key 
points of the image, such as angles, edges, vertices, 
intersections, variation of aperture, lines, isolated 
points, etc . 

20 It is a further a feature of the present invention 

to provide a method for detecting and tracking contours of 
an image that carries out computing steps in a quicker way 
than the systems of prior art . 

It is a particular a feature of the present 

25 invention to provide a method for detecting and tracking 
contours for distinguishing an inner edge from an outer 
edge of the contours of the image. 

It is also a feature of the present invention to 
introduce a new a class of filters, which can be used in 

30 this method for detecting and tracking contours. 

The invention will now summarized with reference to 
grey levels mapping of an image, being it clear that it can 
be extended also to color images. In particular, the word 
intensity is intended to define either the intensity of 
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grey levels pixels, or of color pixels. 

According to the invention, the above described 
objects are achieved by a method for automatically 
detecting and tracking the contour of an image that uses a 

5 class of filters, obtained from the first order absolute 
central moment . 

The method provides the step of filtering a starting 
image through the absolute central moment e(n,m) of the 
intensity of the pixels of said image, being n and jti the 

10 coordinates of each pixel, where the absolute central 
moment is obtained with the following steps: 

Determining for each n,m the local mean calculated on a 
neighborhood about a pixel of coordinates n,m of the 
starting image, obtaining a first filtered image; 

15 - determining for each n,m the sum of the absolute 
differences between the intensity of a pixel of 
coordinates n,m of the first filtered image and the 
intensity of all the pixels contained in a neighborhood 
about the pixel of coordinates n,m of either said starting 

20 image or a second filtered image obtained from said 
starting image. 

Preferably, the sum of absolute differences is 
calculated computing the differences between the first 
filtered image and a second filtered image, derived from the 

25 starting image, obtained for each n,m from a local mean 
calculated on a neighborhood about a pixel of coordinates 
n,m of the starting image. 

Advantageously, the sum of absolute differences is 
split calculating a sum of positive differences, or 

30 positive deviation, and a sum of negative differences, or 
negative deviation. 

According to the invention, the computing operation 
of the absolute generalized central moment of the grey 
levels of a pixel of an image comprises the steps of: 
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- defining four circular domains 0 X , 0 2 , © 3 and 0 4/ 
respectively of radius r lt r 2 , r 3 and r 4 ; 

associating to each domain & ± a weight function w ± ; 
computing a mean weighed value \x L of the grey levels map 
5 for domains 0 X and 0 2 ; 

- computing the absolute generalized central moment 
e(n,m) with a weight function w 3 on domain 0 3 ; 

- splitting the absolute generalized central moment 
e(n,m) into two complementary filters: a positive 

10 deviation e p (n,m) and a negative deviation e n (n,m) that 
produce, near a discontinuity, two partially overlapping 
bell -shaped profiles ; 

convoluting the two positive e p (n,m) and negative 
e n (n,m) deviations with a weight function w 4 on domain 0 4 ; 

15 One of the main advantages of the invention is that 

e n (n,m) produces a bell curve with a peak on a dark edge 
of the discontinuity whereas e p (n,m) produces a bell curve 
with a peak on a bright edge thereof. Normally, then, the 
negative deviation enhances dark structures on bright 

20 background, whereas the positive deviation enhances bright 
structures on dark background. Furthermore, one of the two 
deviations enhances the inner edge of a structure whereas 
the other deviation enhances the outer edge thereof. This 
can be useful for example to distinguish, once defined, an 

25 outer edge from an inner edge of a blood vessel, of a 
cardiac wall, etc. 

Another main advantage is that a function 
Min (e p (n,m) , | e n (n,m) \ ) allows to overcome a computational 
difficulty of searching a " zero-crossing" of the output of 
30 the filter. The overlapping zone of the two components 
represents in fact a very sharp edge that detects directly 
a "zero-crossing" , and then a discontinuity, creating at 
the same time a value proportional to the slope of a 
"zero-crossing" . This computational simplification makes 



the method advantageous for tracking contours of video 
images arranged as succession of photograms. 

Another main advantage is that two standard filters 
often used in computer vision as the DoG (difference of 
5 Gaussian curves) and the GoG (gradient of Gaussian curve) 
can be replaced the first with the sum the two deviations 
positive e p (n,m) + e n (n,m) and the second with the 
difference e p (n,m) - e n (n,m) . This because the results are 
similar . 

10 Another main advantage is that the absolute central 

moment e(n,m) produces a bell -shaped profile at 
discontinuities and produces local maxima at edges, at 
junctions as well as at end points of lines. Then, the 
performances of the absolute central moment are better 

15 than the gradient of Gaussian in the key points of the 
image . 

Another main advantage is that the absolute central 
moment e(n,m) produces a bell-shaped profile also at lines 
and can then can be used for tracking graphs (per example 

20 electrocardiograms) on paper allowing to convert them into 
digital signals. The paper graphs can be scanned and the 
image obtained can be filtered using the absolute central 
moment e(n,m) in order to showing the electrocardiogram by 
a bell -shaped profile. The peak of this bell -shaped 

25 profile is the sought digital signal and can be measured 
with a detection algorithm of standard type of the local 
maxima . 

Another main advantage is that two filtering 
operations obtained with the absolute central moment 
30 e(n,m) using different parameters r lf r 2 , r 3 and r 4 can be 
used for implementing an algorithm of local thresholding 
that compares two images, one with higher noise and lower 
intensity in the peaks and one with lower noise and higher 
intensity in the peaks. 
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Advantageously, the weight functions are selected from 
the group: 

- constant functions, where the value of the constant is 
chosen in order to normalize the target function on domain 

5 0 i; 

- Gaussian functions, wherein weight functions w ± are 
approximated with functions normalized on circular domains 
©i of radius r ± -3 ± . 

According to another aspect of the invention, an 
10 apparatus for tracking the contour of an image comprises 
at least two filters and an Arithmetic Logic Unit (ALU) , 
wherein said filters compute the positive deviation 
e p (n,m) and of the negative deviation e n (n,m) of the 
absolute central moment eCn,in;, as above defined. 
15 m particular, each filter is characterized by a 

predetermined set of parameters consisting of the 
coefficients of the weight functions. Such coefficients 
can be chosen in a start-up phase of the system. 
Typically, the weight functions and the image involve the 
20 same number of bits. The ALU carries arithmetic and logic 
operations on the results of the previous filters 
according to a chosen filtering operation. 
Brief des cription of the drawing? 

Further characteristics and advantages of the methods 
25 according to the present invention will be made clearer by 
the following description, exemplifying but not 
limitative, with reference to the attached drawings 
wherein: 

figure 1 is a graphic representation of the domains 0 X/ 
30 0 2 and 0 3 used when computing the first order absolute 
central moment at a pixel of the image; 

figure 2 shows the output (2b) of two components 
e p (n,m) and e B (n,m) of the first absolute central moment 
near a discontinuity occurred at step (2a) ; 
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figure 3 shows how the output (3a) of e p (n,m) and 
e n (n,m) can be combined to obtain different outputs (3b- 
3d) ; 

figure 4 shows, in case of two starting images (4a and 
5 4d) , the output of the central moment (4c and 4f ) in the 
combination of figure 3b, compared with the output of the 
gradient of Gaussian (4b and 4e) ; 

figure 5 shows, in case of four starting images (5a) the 
output of the filter Min (positive deviation, (negative 
10 deviation]) (5c) in the combination of figure 3d, compared 
to the map of zero-crossing obtained as output to a 
Difference of two Gaussian curves (DoG) (5b) ; 

figure 6 shows a procedure of local thresholding 
according to the invention in many steps thereof, 6a- 6g; 
15 - figure 7 shows a typical application of the procedure 
of local thresholding (7d) , starting from the same images 
of figure 5 (7a) ; 

figure 8 shows a block diagram of an apparatus for 
implementation of the proposed class of filters capable of 
20 analyzing video signals in real time; 

figure 9 shows the block diagram of the filters of 
figure 8; 

In figure 10 an architecture is diagrammatically shown of 
the elementary unit of four convolutors "2D- FIR" of figure 
25 9; 

- figure 11 shows an implementation of a bidimensional 
filter "2D- FIR" from a cascade of two monodimensional 
filters "ID-FIR"; 

in figure 12 shown an architecture is diagrammatically 
30 of an elementary unit of the integrator of figure 9. 

Description of the method 

The method according to the invention starts from a 
generalization of the first order absolute central moment. 
Whereas : 
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- f(n,m) is a map of the grey levels of an image, where 
f assumes one among 256 grey levels values between 0 
and 2 55 for each pixel of coordinates n, m, 

- w 1 (n 9 m), w 2 (n,m), w 3 (n,m) and w 4 (n,m) are four weight 
functions defined on four circular domains 0 1# 0 2 , 0 3 
and © 4/ each point of the domains having coordinates 
(k,l) , and the domains being chosen according to 
special criteria as defined below. 

r lt r 2/ r 3 and r 4 are each a respective radius of & lf 
0 2/ 0 3 and 0 4 , 

the absolute generalized central moment of the first 
order is calculated as follows: 

e(n, m) = w 4 («, m) ® £ £ K m ) " ^ ( n ~ k > m ~ 0| ^ 3 ( k > 0 ( 1 > 
where 

- ® is a convolution operator, 

- the mean value /u^n.m) is calculated as: 

- domains 0 ± are defined as: 

e-KW)^ 2 :^^} (3) 

where i is a generic whole number. 

With reference to figure 1, the first absolute 
generalized central moment measures the variability of the 
mean value of the grey levels contained in circular domain 
0 3 with respect to the local mean value of the grey levels 
calculated in central domain 0 X ; the mean value of the 
grey levels of each point of circular domain 0 3 is 
calculated in a circular domain 0 2 . 

Concerning the weight functions, they can be: 
a constant weight function, chosen in order to 
normalize the function on domain 0 X in the following way 
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(*,/)e0, 



*,(*,/) = • 



(4) 



0 (*,/)«©, 
where ]T = 1 



(5) 



A Gaussian weight function, approximated with 
functions normalized on circular domains ©i of radius 
5 ^=3^, calculated as follows: 

(*,/)e0, 



0 



(6) 



The absolute generalized central moment e(n,m) is then 
split into two complementary filters: a positive deviation 
e p (n,m) and a negative deviation e n (n f m) , and precisely: 



e p (n 9 m) = w 4 (n, m) ® J] ^(jUy(n,m)- ju 2 (n-k 9 m- l))w 3 (k 9 I) 



(*,/)60 



3p 



(7) 



e„ (w, w) = w 4 O, m) ® J] £ (/^ («, m) - // 2 (h - m - l))w 3 (k 9 I) 
where the domains 0 3p and 0 3n are defined as: 



©3, = {(*.*) e© 3 : V x (n 9 m)> ^ 2 {n-k 9 m-l)} 



(8) 



©3« = {(*,/) e® 3 \p x {n 9 m)<p 1 {n-k 9 m-l)} 

The absolute generalized central moment can then be 
obtained as : 



e(n 9 m) = e p («, w) - e n (n, m) ( 9 ) 

figure 2 shows the output (2b) of e n (n,m) and e p (n,m) 
to a test image (2a) with an ideal step-like discontinuity 
10 between two zones with different grey levels 20 and 30. 
20 At the discontinuity 10, e n (n t m) and e p (n,m) give two 
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partially overlapping bell -shaped profiles. On one hand 
e n (n,m) produces a bell curve with a peak on a dark edge of 
the discontinuity, on another hand e p (n,m) produces a bell 
curve with a peak on a bright edge thereof. Normally the 

5 negative deviation enhances dark structures on bright 
background, whereas the positive deviation enhances bright 
structures on dark background. 

Figure 3 shows diagrammatically as the outputs of 
filters e p (n,m) and e n (n > m) can be combined to obtain 

10 different discontinuity outputs. 

- Figure 3a: single components e p (n,m) and \e n (n,m)\ are 
shown as separate bell -shaped curves. 

- Figure 3b: the sum of the positive and negative 
components e p (n,m) + \e n (n,tn)\ gives a single bell-shaped 

15 profile whose peak defines the discontinuity. This output 
is very similar to that obtainable with a gradient of 
Gaussian. 

- Figure 3c : the difference of the positive and negative 
components e p (n,m) - \e n (n,m)\, instead, produces a output 

20 similar to that obtainable with a Laplacian of Gaussian 
filter. The filter produces in fact a zero-crossing at the 
discontinuity. 

Figure 3d: a computational difficulty of searching the 
zero-crossing of the output of the filter is overcome with 
25 function Man (e p (n,m ) , \ e n (n,m) | ) . The overlapping zone of the 
two components represents in fact a very sharp edge that 
detects the zero-crossing, and then the discontinuity, 
creating at the same time a value proportional to the 
slope of the zero-crossing. 

30 Generation of local maxima at the discontinuity 

With the sum e p (n,m) + \e n (n,m)\ the function e(n,m) is 
obtained, which produces a value zero in homogeneous 
regions and local maxima at discontinuities. The absolute 
central moment is a dispersion index that produces a map 
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similar to that of the gradient of Gaussian. Figure 4 
shows how, starting from two images (4a and 4d) linear 
combination e p (n,m) + \e n (n,m)\ generates (4c and 4f) a peak 
at the discontinuity. It is however relevant to observe 
5 that, differently from the gradient of Gaussian (4b and 
4e) , the absolute central moment defines a bell-shaped 
profile both at lines and at step-like discontinuities, 
and it defines local maxima at edges, junctions and end 
points of lines. Then, the performances of the absolute 

10 central moment are better than the gradient of Gaussian in 
key points of the image. 

In the case of Gaussian weight functions, the output 
of the absolute central moment is different as the size 
varies of the domains 0 1# 0 2 , © 3 . In particular the 

15 absolute generalized central moment, if respectively: 

a 1 <a 2 «r 3 - produces a single bell-shaped profile at the 
discontinuity; 

- cr 1 <a 2 <l/2a 3 produces local maxima at the edges; 

a l <a 2 <2/3a 3 } 6a 2 >d; a 3 >d - produces a lines bell curve of 

20 amplitude d. 

By introducing weight function w 1 (n,m) the operator 
is not shown all the junctions with local maxima. On the 
other hand weight function vt x (n % m) is necessary for 
filtering the noise normally present in the images and 

25 cannot be eliminated. For showing all the junctions with 
local maxima the two positive e p (n,m) and negative e n (n,m) 
deviations must be kept separate from each other since 
they provide local maxima at all the junctions. 

It must be noted that the first order central moment 

30 in its standard form is always zero. However, the present 
operator is a generalization of the first order central 
moment and is not always zero. First order central moment: 

c{n, m) = w 4 («, m) ® ]T Yfjh (»> m)-/i 2 (n-k 9 m- l))w 3 (k,l) (10) 

is equivalent to eq. (1) without absolute value 
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condition and this way it can be obtained as sum of the 
two negative and positive components of eq(l) . Developing 
eq. (10) the following results: 

c(n, m) = e p («, m) + e n (n, m) = 

= f(n,m)® (w l (n, m) ® w 4 (n, m) - w 2 («, m) ® w 3 (n, m) <S> w 4 (w, m))= (11) 

= /(w, m) <8> (w„ (w, m) - w t (w, w)) 
5 Eq. (11) shows how in case of Gaussian weight 

functions the sum e p (n,m) + e n (n,m) provides a output 
equivalent to that supplied by a DoG filter (difference of 
Gaussian curves) . 

Map and intensity of the zero-crossing 

10 Hereinafter a filter is indicated obtained by an 

easy algorithm to map and estimate the intensity at the 
zero-crossing . 

The absolute central moment can be split into the 
positive and negative components, and four weight 

15 functions can be put in the original filters. In case of 
Gaussian weight functions, the sum of the output of the 
two positive and negative components is equivalent to the 
output of a DoG filter, independently from the apertures 
oi, <J 2 , <J 3 , <J 4 - However, in the zero crossing of the two 

20 components of the DoG output, the two ridges generated by 
the negative and positive deviations of the absolute 
moment overlap partially. The profile of the overlapping 
area is a thin ridge whose peak defines the discontinuity. 
The height of a peak, furthermore, is proportional to the 

25 discontinuity contrast value. Then an easy algebraic 
function, such as the function Min (positive deviation, 
| negative deviation]), can provide at the same time both a 
map Mpn, which is similar to the map of the zero-crossing 
obtained with the method of Marr-Hildreth (figure 3) , and 

30 an estimation of the intensity of the zero-crossing. 

In figure 5 four images (5a) are shown, of which the 
first is a diagrammatic image with Gaussian noise and the 
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other three are generic images. Then, the charts are 
compared of the zero-crossing, obtained from the 
application on one hand (5b) of a DoG filter (method of 
Marr-Hildreth) , and on the other hand (5c) of the 
5 procedure according to the invention Min (positive 
deviation, \negative deviation\ ) ; the latter shows 
contours similar to those of the zero-crossing charts. In 
the example the low-pass filters are set in the same way 
for both the approaches, the classic apertures have been 

10 used <7 2 =1 . 6o 1 a 3 =0 of a DoG filter. A Gaussian w 4 (n, m) with 
opening <r 4 =0.7 pixels has been finally used to cause the 
two deviations of the absolute moment to overlap. If this 
configuration is used the two deviations are the same as 
the two positive and negative components of the output of 

15 a DoG filter when they are filtered separately with a 
Gassian having a same 0.7 pixels aperture. 

Procedure of local thresholding 

A procedure of local thresholding can be obtained 
combining two charts generated through the following 
20 filters: 

e'(«,m) = £ ^\Mn,m)-f(n-k,m-l)\w 3 (k,l) (12) 

(*,/)e0 3 

e"(n,m) = w 4 (n,m)®Y Y}f^ m )-f(n-k,m-l)\w,(kJ) (13) 

(*,/)e© 3 

In the presence of noise, when r 2 = r 4l on 
homogeneous zones of the image eq. (12) produces less 

25 noise than eq. (13) . At the discontinuity, instead, the 
result is opposite. At the discontinuity eq. (12) produces 
bell -shaped profiles higher than those of eq. (13) . Since 
eq. (12) produces local maxima that are higher at 
discontinuities and lower noise at homogeneous zones with 

30 respect to eq. (13) , the latter can be used as threshold of 
the output obtained with eq. (12) . 

With reference to figure 6, then, starting from a 
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test image 6a, to which has been summed Gaussian noise, 
the filters are applied of eq. (12) and eq. (13) , 
obtaining respectively the images 6b and 6c ; the graphs 6d 
and 6e show the profile of the grey levels obtained 

5 respectively from images 6b and 6c at the rows there 
represented; by thresholding the image of graph 6d with 
the curves of graph 6e, profile 6g is obtained; in the 
latter the elimination of the noise is apparent, as 
resulting from the procedure of local thresholding. 

10 As shown in figure 7, using a local thresholding 

procedure with images of row 7a, the same of figure 5a, by 
filtering them with eq. (10) , the images are obtained of 
row 7b, and filtering them with eq. (11) the images are 
obtained of row 7c, and thresholding the images of row 7b 

15 with the images of row 7c the images of row 7d are 
eventually obtained. 

From the above comes that the filters according to 
the invention, obtained from a generalization of the first 
order absolute central moment, even if they have 

20 functionalities similar to some filters frequently used 
(gradient of Gaussian, Laplacian of Gaussian, difference of 
Gaussian curves, etc.), are advantageous because in a single 
filter the following features are concentrated: 

- by adjusting the parameters of the first order absolute 
25 central moment the filters resulting therefrom can provide 

the same results of traditional filters such as gradient 
of Gaussian, Laplacian of Gaussian and difference of 
Gaussian curves, 

- both first and second order derivative filters can be 
30 implemented, 

- at the same time the detection of the zero-crossing of 
the second order derivatives and an estimation of their 
intensity can be obtained, 

they can be used for implementation of an algorithm of 
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local thresholding , 

- it is possible to show separately the inner edge and 
the outer edge of a a structure, or also separately dark 
objects on bright background and bright objects on dark 

5 background, 

- it is possible to show, by means of local maxima, key 
points of the image such as edges, junctions and end 
points of lines, as well as isolated points, 

- it is possible to show with a ridge the central line of 
10 a plurality of lines having thickness not zero, as well as 

they can be used for tracking graphs (for example ECG) 
previously printed on paper, 

- as well as they can be used, through the above described 
key points, to build panoramic images of a structure 

15 starting from a plurality of scanned images taken from 
different directions. 

Description of a prefer red Hardware 

In applications where a few images must be filtered, 
the algorithm according to the invention can be 

20 implemented efficiently through a common computer. In much 
heavier applications, such as filtering in real time video 
signals, the class of filters can be loaded by a dedicated 
hardware as that described in this example. 

The apparatus is a device capable of implementing 

25 the whole class of filters according to the present 
invention. It can analyze in real time a continuous flow 
of images with resolution and frame-rate typical of a 
common video standard. Both the input video signal and the 
output signal are in digital format. For example, they can 

30 be a succession of 8 bit whole numbers representing 256 
grey levels images. If the size of the images is 512x512 
pixels and there are 25 photograms per second, then the 
pixels frequency, i.e. the data . rate, is 
f p =512x512x25=6 . 5536 MHz. 
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The apparatus can be described by a HDL language 
(Hardware Description Language) , which defines univocally 
its architecture and allows its implementation on a 
circuit board. The choice of the device on which to map 

5 the architecture depends, instead, on production reasons. 
To achieve flexibility and rapidity of development of the 
product it is possible use programmable logic devices, 
such as FPGA (Field Programmable Gate Array) and CPLD 
(Complex Programmable Logic Device) . If, vice versa, the 

10 performances and the final cost of the device are more 
relevant, an ASIC integrated circuit (Application-Specific 
Integrated Circuit) can be used. In both cases, external 
memory units may be necessary, for temporary data storing. 

The architecture of the apparatus, shown in figure 

15 8, consists of one or more filters 1 and of an ALU 2 
(Arithmetic Logic Unit) . The filters compute the positive 
deviation e p (n,m) and the negative deviation e n (n,m) . Each 
filter is characterized by a predetermined set of 
parameters consisting of weight coefficients w 1 (k,l) 

20 w 2 (k,l) w 3 (k,l) w 4 (k,l). Such coefficients can be chosen in 
phase of start up of the system. Typically, the bit number 
necessary for the weight functions is the same as the bit 
number necessary for showing the image . The ALU carries 
out arithmetic and logic operations on results from 

25 previous filters, according to a chosen filtering 
operation. 

The minimum configuration of the apparatus provides 
a single filter, and the ALU carries out only one 
operation between positive deviation and negative 
30 deviation. In the case, for example, where local maxima 
are sought at the discontinuity, the ALU carries out a 
difference operation between the two deviations. 



g{n, m) = e(n, m) = e p (n,m)- e n (n, m) 



(14) 
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From the sum of the two deviations: 

g(n 9 m) = e p (n 9 m) + e„(n,/w) (15) 

are obtained, instead, zero-crossings at the 

discontinuities . 

5 In a more general case there are two filters, the 

ALU has input components obtained both from the first 
filter e' p (n,m) e' n (n,m) and from the second filter e" p (n t m) 
e" n (n,m) . This configuration can be used, for example, for 
operations of local thresholding. The operation carried 

10 out by the ALU is the following: 

[e\n 9 m) = e\{n 9 m)- e\ (n 9 m) 



\e\n 9 m) se e\n 9 m)>e"{n 9 m) 
g(n 9 m) = \ (17) 
10 se e\n,m)<e u {n 9 m) 



15 The architecture of filter 1, shown in figure 9, has 

four FIR bidimensional convolutors and an integrator. The 

four convolutors implement the convolutions (2) of the 

image f (n f m) with masks w 1 (k,l) w 2 (k,l) and two 
convolutions (7) of the signals e p (n,m) and e n (n,m) with 

20 mask w 4 (k,l) . 

The integrator implements the sums of eq. (7) and 
given hereafter: 



e p (n 9 m) = £ £ («, m) - ju 2 (n - k 9 m - l))w 3 (k 9 l) 

(18) 



K ( n > m ) = Z Z (mi (*> m ) - M 2 (" - k > m - 0 K (*> o 

(*,/)ee 3n 

25 If 256 grey levels images are treated, it is 

possible to represent all the signals f (n,m) , 1 (n,m) , 
2 (n,m), e p (n,m) , e n (n,m) , e p (n,m) , e n (n,m) , by means of 8 bit 
whole numbers. This approximation is a good bargain 
between precision of the result and complexity of the 

30 hardware . 
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The convolutors, whose block diagram is shown in 
figure 10, have a certain number of elementary units. The 
operation carried out by each unit is a multiplication- 
and-sum, owero: 
5 - multiplication between element f(n,m) of the image and 
coefficient w(k,l) of the convolution mask. 

- sum s(k,l) between the result of the multiplication 
and the value s(k,l-l) obtained by the previous unit. 
Each unit consists of the following elements: 
10 - a delay unit 5 . 

- a register 6 where the coefficient of the convolution 
mask is recorded. 

- a multiplicator 7. 

- an adder 8 . 

15 If 256 grey levels images are treated, elements 5 

and 6 are implemented by means of 8 bit registers. Both 
multiplicator 7 and adder 8 are instead implemented using 
a combinatorial logic. The former has 8 bit inputs and 16 
bit outputs, whereas the size of the latter depends on the 

20 size of the partial sum s(k,l-l). In some implementations, 
it can be advantageous to provide multiplicator and adder 
on a single combinatorial network having three inputs and 
an output . 

If the computing rate of the unit is the same as the 
25 pixel frequency, it is possible to provide a 
multiplication-and-sum for each clock cycle. This means 
that for a convolution in real time it is necessary to use 
a same number of units as the size of the convolution mask 
of w(k,l) . However, if quick semiconductor devices are 
30 used, it is possible to remarkably reduce the size of the 
convolutor and then the complexity of the integrated 
circuit that implements it. For example, where the 
computing rate of the unit is N times the pixel frequency, 
it is possible to use a same unit for carrying out 
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multiplication-and-sum of the image and N values of the 
convolution mask w(k,l), which are loaded cyclically in 
register 6. This way, the size of the convolutor is 
reduced by a factor N. 

5 By a tridimensional convolutor a convolution can be 

implemented with an desired weight function u^fJc,!,) 
defined in a circular domain &± However in case 
particular functions are used, for example Gaussian 
curves, another procedure can be used for reducing the 

10 size of the convolutor . 

If weight functions i(k,l) are used defined on a 
square domain: 

0/ = {(£,/) e/ 2 :-r. Zk^rr-r. <t<r.} (19) 

From the comparison with eq. (3) the square domain 
15 includes the circular domain: 0,c©i. If the numerical 
values of function i(k,l) outside the intersection 
between the two domains can be neglected, the convolution 
with w^k,!) and the convolution with i(k,l) are 
equivalent . 

20 If, furthermore, function i(k,l) is separable, i.e. 

it is possible to define two functions n (k) and i2 (D 
such that : 

*,(*,/) = *„(*)•*„(/) (20) 
25 Then the bidimensional convolution with i (k,l) is 

equivalent to a series of two monodimensional convolutions 
with n(k) and i2 (l) respectively. In the case, for 
example, of computing a mean value of function f(n,m), eq. 
(2) becomes: 



30 Mi(n,m) = Y £/(n-*,m-0*,(*,0=E (*) 



w i2 (l) (21) 



where i2 (k) and i2 {l) are defined in monodimensional 
domains : 
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<D n ={kel:-r ix <k<r n } 

" M (22) 

<I> f2 ={/e/:-r f2 S/£r, 2 } 

With these hypotheses, the bidimensional convolutor 

can be implemented by a cascade of two monodimensional 

convolutors, as shown in figure 11. In case of 8 bit data, 

5 the dimension of the elements of the elementary unit of 
the first convolutor 9.1 is the same as described 
previously. The output data r(n,m) from the first 
convolutor are, instead, represented by a higher bit 
number: 16 + Log 2 (2 • r i± +l) . However, in most cases, it is 

10 possible to approximate this data by a 8 bit whole number. 
With this further approximation, also the size of the 
elements of the elementary unit of the second convolutor 
9 . 2 remains unchanged . 

When turning from a bidimensional convolution on a 

15 square domain to two monodimensional convolutions, the 
number of single units necessary to the operation is 
reduced from (2r i +l) 2 to 2(2r i +l). In case of circular 
domains, the number of single units is normally less than 
(2r i +l) 2 , since 0. c0i. However, the advantage deriving 

20 from the passage to monodimensional convolutions is still 
remarkable . 

The integrator has units whose architecture is shown 
in figure 12. With reference to equations (18), the 
operations implemented by each unit are the following: 
25 - subtraction between 1 (n,m) and 2 (n-k,m-l) 

- multiplication with the coefficient of matrix w 3 (k,l) 

- if the result of the subtraction is positive: it 
sums the value s p (k,l) coming from the result of the 
multiplication and the value s p (k,l-l) obtained by the 

30 previous unit . 

- If the result of the subtraction is negative: it 
sums the value s n (k,l) of the result of the 
multiplication and the value s n (k,l-l) obtained by the 
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previous unit . 

The elements of each elementary unit are the 

following: 

- a delay unit 10 . 

5 - a register 11 where the coefficient of the 
convolution mask is recorded. 

- a subtractor 12 with "carry" (borrow) . 
a multiplicator 13. 

- a zero constant 14 . 

10 - two multiplexer elements 15.1 and 15.2. 

- two adders 16.1 and 16.2. 

If 256 grey levels are treated, elements 10 and 11 
are implemented by means of 8 bit registers. All the other 
elements, numbered from 12 to 16.x, are instead 
15 implemented by combinatorial logic. The subtraction 12 is 
between 8 bit factors with 8 bit results, whereas the 
multiplication 13 is between 8 bit factors 16 bit results. 
The size of multiplexer 15.x and of adders 16.x depends on 
the size of the partial sums s p (k,l-l) and s n (k,l-l) . 
20 If the computing speed of the unit is the same as 

the pixel frequency, the integrator has W 2 units, where M 
is the size of the mask w 3 (k,l). As already discussed for 
convolutors, with a quick semiconductor device it is 
possible to use a same unit for calculating N elements of 
25 the sum. This way also the size of the integrator is 
reduced by a factor N. 

The foregoing description of a specific embodiment 
will so fully reveal the invention according to the 
conceptual point of view, so that others, by applying 
30 current knowledge, will be able to modify and/or adapt for 
various applications such an embodiment without further 
research and without parting from the invention, and it is 
therefore to be understood that such adaptations and 
modifications will have to be considered as equivalent to 
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the specific embodiment. The means and the materials to 
realise the different functions described herein could 
have a different nature without, for this reason, 
departing from the field of the invention. It is to be 
5 understood that the phraseology or terminology employed 
herein is for the purpose of description and not of 
limitation. 



